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Findings from prior research in various content domains have indicated that 
Peer Assisted Study Sessions (PASS) attendees earned higher final grades 
than non-attendees. However, uftat makes PASS effective remains unknown , 
for example. PASS could improve short-term retention but hinder long-term 
maintenance of course content given that some methods that faahtate short¬ 
term retention of information hurt long-term retention. Of additional interest 
uas what predicts students' attendance in PASS We tracked 7S introductory 
psychology students' short- and long-term retention of course content ina 
unit quizzes and a cumulative final exam, respcctiicly, to determine if PASS 
attendance improied both types of retention Results indicated that PASS 
attendees had significantly higher academic self-efficacy and final grades 
than non-attendees Attendees outperformed non-attendees on three of the 
six quizzes and on the cumulative final exam, supporting both the short- and 
long-term effectiveness of PASS 
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T 

JL ransitioning from high school to 
college proves difficult for many students (Brinkworth, McCann, 
Matthews, & Nordstrom, 2009). Students often find themselves ill- 
prepared for the academic and social challenges of college, which can 
increase their risk of failing or dropping out (Baths, 2009). One fee- 
tor that contributes to students' academic struggles is that they enter 
introductory-level college courses with preconceived notions about how 
to learn and study based on experiences from their high school classes, 
but the study strategies that worked for the students in high school 
may no longer prove effective in the new college learning environment 
(Congos & Schocps, 1998; McGuire, 2006). Unfortunately, students who 
have been using the same strategics for a long time may be reluctant 
to try a different strategy even if their current strategy is ineffective. 
Students may also not know which strategics would be most effective 
or how to implement them. 

Komcll and Bjork (2007) found that 80% of the 472 introductory 
psychology^ students queried about their study methods said they had 
never been taught how to study’ and that students simply improvised 
their method of studying. Komcll and Bjork's research also revealed that 
many students were unaware of what Bjork (1994) termed 'desirable 
difficulties, 4 or study methods that introduce difficulties during study, 
but enhance long-term learning (c.g., self-testing and spacing of study’ 
activities). Schmidt and Bjork (1992) noted that many of the study’ 
techniques that slow down the encoding process (Lc., these desirable 
difficulties) serve to enhance long-term retention of information, 
whereas study’ methods that facilitate rapid encoding (c.g., massed 
practice) often hinder long-term maintenance. Ideally students would 
use study techniques that facilitate long-term retention of course content. 
However, the results of Komcll and Bjork’s survey suggest that without 
direct instruction students may’ remain ignorant of the benefits of these 
study methods. 

Many universities have begun implementing supplemental instruction 
(SI) programs to address these issues in order to help students transition 
to and succeed in college. SI programs were first developed in 1973 as 
a way to increase the performance of college students (Hurley, Jacobs, 
& Gilbert, 2006), in particular in high-risk courses (McGuire, 2006) 
defined as those with an increased failure or dropout rate, meaning 
that 30% or more students receive an "F # or withdraw from the course 
(Lewis, O’Brien, Rogan, & Shorten, 2005, Lockic & Van Lanen, 2008). 
The courses selected for SI arc usually introductory-level courses that 
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students encounter in their first or second semester of college as part of 
their general education requirements. Because many of these courses 
arc outside the students’ majors, students may need to adopt new study 
strategies different from those used in their major couiscwork or from 
those used in high school. Many students arc simply not prepared to 
adapt to these challenges. Thus, SI programs arc designed to help stu¬ 
dents determine which learning and study strategics wall help them 
pass a specific course (Congos S' Schocps, 1998). 

Since the initial development of SI f several types of these programs 
have been created. All focus on helping college students perform better 
in their courses. One type of SI is Peer Assisted Study Sessions (PASS; 
Lewis ct al., 2005), which occur in 50-minute periods outside of class 
three times per week. Students attend on a strictly voluntary basis. 
The PASS leader, a student who has previously taken and done well 
in the course, attends each class with the students, takes notes, and 
reads all assigned reading materials. The PASS leader develops a les¬ 
son plan for each session, takes attendance 1 , and outlines the material 
covered in each session. The role of the PASS leader is to facilitate the 
students’ discussion by adding relevant examples, posing questions, 
and modeling what a successful student would do to reach the correct 
solution for questions posed by the PASS leader or PASS attendees, as 
opposed to re-lecturing the material covered by the professor (Martin 
S' Arcndalc, 1994). The PASS leader allows students to lead the dis¬ 
cussion to cover whatever topics the students arc having difficulty 
understanding. Howcvci; if students do not have specific questions, 
the PASS leader draws upon the lesson plan for that session to address 
and initiate discussion about critical course concepts. Thus, the PASS 
leader presents information related to the course material and encour¬ 
ages the students to discuss possible solutions to the problems posed 
by other students (Lewis ct al., 2005). 

PASS leaders undergo extensive training to ensure they arc prepared 
to meet the goals of the SI program. Because a lack of training is one 
of the most common reasons for an SI program’s failure, proper train¬ 
ing of the PASS leader is vital to the program’s success (Lipsky, 2006). 
Once PASS leaders arc selected by the class professors and interviewed 
by those overseeing the PASS program at The University of Alabama in 
Huntsville, they must attend a 12-hour training course on what being a 
PASS leader requires, including training on learning and study strategics 
and on facilitating students’ learning. The training is in keeping with 
national standards for PASS and consists of workshops that emphasize 
the theoretical bases of learning, teaching methods, study strategies, 
and possible problems that might be encountered in PASS (Martin S' 
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Arcndalc, 1994). PASS leaders also hold multiple practice sessions in 
which they must demonstrate that they understand the learning strat¬ 
egies and course material they will be presenting during the sessions 
(Martin S' Arcndalc, 1992). 

Hie overall goal of PASS is to increase students’ performance in high- 
risk courses by increasing their knowledge of study strategies. The 
students learn which strategies will be effective for learning specific 
course material and how to implement those strategics. Students arc 
also taught to monitor which strategics they utilize while studying and 
how each strategy affects later recall of course material on the quiz. 2 
All of these elements contribute to enhanced student performance in 
high-risk courses (Lewis ct al., 2005). 

Studies that have focused on the effectiveness of SI programs such as 
PASS have found that PASS attendance decreases dropout and failure 
rates in these high-risk courses. PASS attendees obtain higher final grades 
on average than the students who choose not to attend (see Congos S' 
Schocps, 1993, 1998; Lewis ct al., 2005). However, none of these stud¬ 
ies has addressed what contributes to this difference in final grades. Of 
particular interest is whether PASS serves to facilitate both short- and 
long-term retention of course material. One would expect PASS to ben¬ 
efit both types of retention given that PASS incorporates many of the 
previously noted desirable difficulties (c.g., spaced practice, self-testing, 
feedback regarding understanding of content; Bjork, 1994). However, it 
remains possible that PASS could benefit short-term retention without 
affecting long-term retention of course content. The present study was 
designed to examine what makes PASS effective and whether students 
who attend PASS demonstrate enhanced short-term and long-term reten¬ 
tion as assessed by unit quizzes and a cumulative final exam, respec¬ 
tively, relative to students who choose not to attend PASS. 

An additional question was why some students choose to attend 
PASS and others do not. Specifically, we wondered whether academic 
self-efficacy or certain indicators of ability level (c.g., entrance exam 
scores and high school grade point average) might predict participation 
in PASS. Within the first week of classes containing PASS leaders, the 
benefits of PASS arc made explicit. The instructor tells all students that 
prior research has found that students who attend PASS tend to cam 
higher grades than those who choose not to attend. Nonetheless, some 
students opt out of this opportunity. 3 We wondered why and whether 
students' academic sclf-cfficacy and ability levels would affect their 
tendency to attend PASS. 

Self-efficacy, a cognitive construct that influences the acquisition and 
retention of new information (Bandura, 1977), is a motivating force 
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behind students’ learning (Pintrich S' DcGroot, 1990). More specifically, 
the level of students' sclf-cfficacy reflects their belief that they can 
accomplish a particular task and influences which tasks they attempt, 
the amount of effort they expend on the task, and how long they persist 
in the face of obstacles (Lent, Brown, S' Gore, 1997). Individuals with 
higher levels of sclf-cfficacy will attempt difficult tasks and continue 
to persist even after encountering several obstacles (Schunk, 1990). In 
contrast, individuals with lower levels of sclf-cfficacy arc more likely to 
visualize themselves failing, which weakens motivation and unde mines 
their performance, and causes them to give up on a task before even 
attempting it (Bandura, 1989). Individuals with higher levels of perceived 
sclf-cfficacy arc more likely not only to participate in tasks, but also to 
excel at them, whereas individuals with lower levels of perceived self- 
efficacy arc more likely to avoid the tasks altogether (Schunk, 1990). 

Prior research has found that students who choose to attend PASS early 
in the semester have higher self-esteem (Pclcd S' Kim, 1996) and arc 
better prepared academically (Martin S' Arcndalc, 1992). Self-esteem 
reflects individuals' overall evaluations of themselves (Bandura, 1977). 
Sclf-cfficacy is a concept related to self-esteem, but reflects individuals' 
beliefs regarding their ability to successfully complete a task (Bandura, 
1997). Given Pclcd and Kim's findings and the relationship between 
self-esteem and self-efficacy, we expected to find that those with higher 
academic sclf-cfficacy would be more likely to attend PASS than would 
those with lower self-efficacy. Tb test this hypothesis we used a longitu¬ 
dinal design to compare students in an introductory psychology course. 
Our goal was to compare the students who voluntarily attended PASS 
sessions with those who chose not to attend this form of SI. We hoped to 
determine what role PASS played in the students' learning and whether 
PASS attendees differed from the non-PASS attendees in sclf-cfficacy as 
well as in short- and long-term retention of course material. Based on 
the previous research demonstrating that PASS attendees earn on aver¬ 
age a full letter grade higher for their final grade than students who do 
not attend PASS (Congos S' Schocps, 1993, 1998, Lewis ct al., 2005), we 
hypothesized that the PASS attendees would obtain higher final grades 
than the non-PASS attendees. Because quiz grades and final exam grades 
contribute to the students' final grades, we also hypothesized that the 
PASS attendees would obtain higher grades on the unit quizzes and cumu¬ 
lative final exam than the non-PASS attendees. Higher performance by 
PASS attendees relative to non-attendees on the quizzes and final exam 
would provide support for both short-term and long-term retention of 
course material, respectively. 
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Method 

Rirticipants 

Seventy-fivc undergraduate students enrolled in an introductory psy¬ 
chology course at The University of Alabama in Huntsville participated 
in this study for course credit. However; we removed eight students 
(one from the PASS group and seven from the non-PASS group) from 
the analyses because they either withdrew from the course or had 
missed two or more quizzes (Le. f dropped the course without officially 
withdrawing), resulting in a failing grade for the course. The remaining 
67 students were included in our final sample. Of those 67 participants, 
42 attended PASS at least once throughout the course of the semester 
and 25 did not attend. Demographic information for these two groups, 
henceforth referred to as PASS and non-PASS attendees, may be found 
in Thblc 1. There was diversity in the students' age, gender, ethnicity, 
and class standing given that Tlic University of Alabama in Huntsville 
is an urban four-year university that grants both undergraduate and 
graduate degrees. However, t tests indicated there were no significant 
differences between PASS attendees and non-attendees for these factors 
or any others listed in Thblc 1, all ps > .05. Thus, any differences in PASS 
attendees' versus non-attendees’ performance cannot be attributed to 
pre-existing differences in group characteristics. 

Design 

A 2 (Attendance: PASS vs. Non-PASS attendees) x 7 (Data Collection 
Sessions) mixed design was used for this study. The bctwccn-subjccts 
variable was PASS attendance. The within-subjects variable was the 
seven in-class data collection sessions during the spring 2009 semester. 
In addition to descriptive statistics, we used repeated measures analyses 
of variance (ANOVAs) and t tests to examine the impact of PASS atten¬ 
dance on course performance. 

Materials 

The lectures, unit quizzes, and cumulative final exam were based on 
material in the Psychology (Bernstein, Penner; Clarkc-Stcwart, & Roy, 
2008) textbook. Each of the six unit quizzes contained 30 to 35 multiple- 
choice questions assessing content from multiple textbook chapters. 
The cumulative final contained 70 multiple-choice questions covering 
material from the entire semester. 

Academic self-efficacy was assessed using the Self-Efficacy for Learning 
Form (SELF; Zimmerman & Kitsantas, 2005), a 57-item self-report inven¬ 
tory where participants indicate their ability to accomplish the task set 
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Tkblc 1 

Demographies for PASS and Non-PASS Attendees 



PASS (n - 42) 

Non-PASS (n - 25) 


M 

(SE) 


(S£) 

Percent Female 

S3 

64 



Age 

19.90 

(J4) 

19.00 

(.22) 

Year in School (96) 





Fni&hman 

60 


52 


Sophomore 

28 


28 


Junior 

5 


12 


Senior 

5 


8 


Dual Enrollment 

2 


0 


GPA 

3.32 

(.09) 

3.37 

(.11) 

ACT 

23.76 

(.61) 

22.88 

(.99) 

Preteat-SELF 

68.77 

(1.91) 

63.87 

(2.05) 

Poettest-SELF 

68.37 

(2.15) 

64.36 

(2.74) 


Note Ihcse represent the mean and standard error GPA - high school grade point 
average, ACT - Composite Soon: on die ACT. Pretest-SKLP - self-efficacy scores 
collected at the beginning of the semester, Fosttest-SilLF - self efficacy scores 
collected Owud the end of the semester 
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forth in the question on a scale of 0 (definitely cannot) to 100 (definitely 
can). Items measure students’ level of academic self-efficacy regarding 
‘reading, note taking, test-taking, writing and studying," w T hcrc higher 
numbers indicate higher self-efficacy (Zimmerman & Kitsantas, 2005, p. 
403). The SELF has been demonstrated to be a reliable, valid measure of 
the self-efficacy construct, for example, Zimmerman and Kitsantas (2007) 
obtained a Cronbach's alpha of .96 and a correlation of .72 between teach¬ 
ers' ratings of students and students’ responses on the SELF. 


Procedure 

Data were collected seven times throughout the course of the semester. 
Six of those data collection days were the six unit quizzes. The cumula¬ 
tive final exam provided the last data point. Participants were asked to 
complete the SELF before the first quiz and a second time before the sixth 
quiz. The SELF was administered two times to assess whether academic 
self-efficacy changed across the course of the semester and whether 
the measure would yield adequate tcst-rctcst reliability in our sample. 
Demographic information was collected on the day of the fourth quiz. 

Results 

There were two key goals in this study. The primary goal was to inves¬ 
tigate PASS effectiveness by examining how PASS attendance affected 
introductory psychology students’ short- and long-term retention of 
course material, as measured by their performance on the quizzes 
and the cumulative final, respectively. A secondary goal was to assess 
whether academic self-efficacy or indicators of ability level would allow 
us to predict which students would choose to attend PASS. Both goals 
were designed to yield a more fine-tuned analysis of what predicts PASS 
effectiveness and attendance than provided by prior research, which 
has used the final course grades and failure and dropout rates of PASS 
versus non-PASS students as indicators. However, to allow comparison 
of our results with prior research, we began by examining whether final 
grades and failure or dropout rates differed as a function of PASS atten¬ 
dance (Congos & Schocps, 1998; Lewis ct al., 2005; Martin & Arcndalc, 
1994; McGuire, 2006). In all reported analyses, PASS attendees were 
students who attended PASS one or more times throughout the course 
of the semester. Tbblc 2 contains information regarding the number of 
students who attended PASS before each of the six quizzes. 
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•Bible 2 


Number of PASS and Non-PASS Attendees Before Each Quiz 




Non-PASS 

Quiz 1 

4 

63 

Quiz 2 

18 

49 

Quiz 3 

26 

41 

Quiz 4 

20 

47 

Quiz 5 

28 

39 

Quiz 6 

30 

37 


Note Ihcse represent the to to] number of students who chose to attend 
PASS or not attend PASS before each qua 


PASS Effectiveness 

Vfc first conducted an independent samples f test to compare final 
grades between the students who chose to attend PASS and the students 
who chose not to attend. Consistent with prior research, PASS attendees 
obtained on average a significantly higher final grade in the class than 
did the non-PASS attendees, f(S6) « -3.60, p < .01, d - .69 (sec Table 3 
for the means and standard errors). Of our sample of 67 students, only 
5% (i.c. f 2 out of 42) of the students who attended PASS failed the course, 
whereas 20% (i.c., 5 out of 25) of the students who did not attend failed 
( see Figure 1 for the grade distribution). In terms of dropout rates, only 
one student who withdrew from the course attended PASS. Further 
examination revealed that these PASS attendees who failed or withdrew 
from the class had attended only one PASS session early in the semester. 

Ib gain a better understanding of what contributed to this difference 
in PASS versus non-PASS attendees' final grades, we looked for any 
group differences in short- and long-term retention of course content 
as measured by unit quizzes and the cumulative final exam, respec¬ 
tively. We used a repeated measures analysis of variance (ANOVA) 
and t tests to assess whether the observed difference in final grades 
was due to students' quiz grades, grades on the cumulative final exam, 
or a combination of both variables. The repeated measures ANOVA, 
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Thblc 3 


Mean Quiz , Exam , and Final Grades for PASS and Non-PASS Students 




PASS 

Non-PASS 

Quiz 

Af 

(5£? 

Af 

<SE) 

Quiz 1 

72.18 

(3.10) 

76.00 

(3.82) 

Quiz 2 

67.19 

(3.41) 

61.13 

(4.41) 

Quiz 3 

62.56 

(2.88) 

51.88 

(4.45) 

Quiz 4 

74.24 

(2.72) 

71.40 

(3.60) 

Quiz 5 

80.88 

(2.44) 

6635 

(3.38) 

Quiz 6 

77.73 

(2.67) 

67.29 

(4.00) 

Final Exam 

75.51 

(2.05) 

63.09 

(3.73) 

Final Grade 

81.64 

(1.61) 

70.25 

(2.66) 

Extra Credit 

17.98 

(.61) 

14.96 

(.47) 


Note Ihcse represent the means and standard errors of the percent score each student 
obtained on Quizzes 1 through ti for the reduced data set (it - 87); PASS has been 
defined as attending one PASS session throughout the semester 


which evaluated changes in the quiz grades as a function of PASS atten¬ 
dance, yielded both a main effect for quizzes, F(5, 61) «» 12.23, p < .001, 
x\ 2 ■ .50, and a reliable interaction of quizzes with PASS attendance, 
F[S, 61) - 2.47, p < .05, q ? 2 = .17. Because this omnibus test indicated 
significant differences in quiz grades across time for PASS versus non- 
PASS students, we ran additional t tests for each quiz to determine where 
the differences existed. 

We first examined performance on Quiz 1 to determine if there were 
pre-existing differences in performance between PASS and non-PASS 
attendees that might cloud interpretation of any later differences in 
performance. PASS and non-PASS attendees began the semester with 
similar performances on Quiz 1, f(65) « 0.77, p > .05, d ■ .19, and 
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Figure 1 

Final Letter Grades Obtained by PASS and Non-PASS Attendees 
54 i- 



non-PASS attendees actually had slighdy higher scores on this quiz than 
PASS attendees (sec Thblc 3). However, PASS attendees outscorcd non- 
PASS attendees on the remaining five quizzes, although only Quizzes 
3, 5, and 6 proved to be significantly different, f(65) « -2.11, p < .05, 
d » .52, f(65) « -3.15 ,p <.01, d - .75, and f(65) - -2.25 ,p < .05, d - 
.55, respectively. 4 

We conducted additional analyses to determine if* the PASS attend¬ 
ees performed better on the cumulative final exam than the non-PASS 
attendees. An independent samples f test indicated PASS attendees 
scored significantly higher on the cumulative final exam than did 
non-PASS students, f(65) - -3.18, p < .01, d « .69. Study strategics 
being taught in PASS facilitated short-term retention of information by 
helping students encode the information for each quiz and also appeared 
to enhance their long-term retention of the information. 

PASS Attendance and Self-Efficacy 

Of additional interest was whether students’ self-efficacy might predict 
whether they chose to attend PASS. Tb investigate this issue, we first 
looked at the relationship between both the pretest and posttest global 
academic self-efficacy scores and PASS attendance. The correlation 
between pretest SELF scores and PASS attendance was r(65) - .20; the 
correlation between the posttest SELF scores and PASS attendance was 
r(62) * . 14. In both cases, the correlations were positive, but neither was 
significant, p > .05. However; in prior research when relationships were 
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found between self-efficacy and PASS attendance, it was for those with 
higher self-efficacy levels (Pclcd Sr Kim, 1996). We, therefore, divided our 
sample into groups based on their pretest SELF scores (Zimmerman Sr 
Kintsantas, 2005) collected at the beginning of the semester to examine 
if those with higher self-efficacy were more likely to attend PASS than 
those with lower self-efficacy. These pretest SELF scores ranged from 
44.21 to 89.47 (maximum possible - 100), which wc then divided into 
low, medium, and high self-efficacy groups relatively equal in number. 
Those with pretest SELF scores less than 61.11 were assigned to the low 
self-efficacy group (n ■ 22 ); those with scores greater than this number 
but less than 72.74 were assigned to the moderate self-efficacy group 
(n ■ 23); and those with scores over 72.75 w r crc assigned to the high 
self-efficacy group (n ■ 22). Wc then examined whether the relation¬ 
ship bctw r ccn PASS attendance and self-efficacy might differ for these 
three groups. These analyses revealed a significant positive relationship 
between self-efficacy and PASS attendance for those in the high self- 
cfficacy group, r(65) * .28, p < .05, but a significant negative relation¬ 
ship between self-efficacy and PASS attendance for those in the 1ow t 
self-efficacy group, r(65) « -.32, p < .01. In other words, students in the 
high self-efficacy group were more likely to attend PASS the higher their 
SELF scores were. In contrast, in the low sclf-efficacy group, students 
with lower self-efficacy scores w r cie more likely to attend PASS than 
were those with higher SELF scores. No relationship existed between 
PASS attendance and self-efficacy for those in the moderate self-efficacy 
group, r(65) * .04, p > .05. However, by the end of the semester, the 
students' level of self-efficacy did not correlate significantly writh PASS 
attendance, despite the overall pattern of behavior being the same for 
low (if 62) - -.13, p > .05), medium (if 60] * .01, p > .05), and high sclf- 
cfficacy students (if62) « .13, p > .05). Tbst-rctest reliability analyses 
of pretest and posttest SELF scores, r(67) * .66, p < .01, and a repeated 
measures ANOVA revealed that self-efficacy ratings did not change sig¬ 
nificantly across the semester, F( 1, 62) - .10, p - .75, x\ 9 2 ■ .01; thus, 
the absence of significant correlations between the posttest global self- 
efficacy scores and PASS attendance cannot be attributed to changes in 
ratings. These results suggest that early in the semester those highest 
and lowest in sclf-efficacy arc more likely to attend PASS than arc those 
with moderate sclf-efficacy levels, but that sclf-cfficacy has less impact 
on PASS attendance later in the semester. 

PASS Attendance and Academic Performance 
Finally, wc examined the relationship between the two measures of 
performance: high school grade point average (GPA) and ACT scores 5 
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and PASS attendance. Here we found no significant relationship between 
PASS attendance and either GPA, r(50) - -.06, p > .05, or ACT test scores, 
r(56) - .11, p > .05. 


Discussion 

Although SI and PASS have been studied extensively (see, c.g., Lewis 
ct aL, 2005; Lipsky, 2006; Martin & Arendale, 1992), to date no research 
has focused specifically on the issue of what makes PASS effective. Our 
primary goal in this study was to understand what predicts PASS effec¬ 
tiveness by examining whether the previously observed differences in 
final grades (c.g., Congos & Schocps, 1993, 1908) were due to improve¬ 
ments in the short-term or long-term retention of course content This 
question of what drives PASS effectiveness is important from both a 
theoretical and a practical standpoint. From a theoretical perspective, 
it seems important to evaluate whether the desirable difficulties (Bjork, 
1994) that have proven beneficial in lab-based settings yield similar ben¬ 
efits when tested in classroom settings. If these desirable but difficult 
behaviors that arc modeled and implemented in PASS <c.g., spacing 
practice, gaining feedback about one's understanding of critical course 
concepts, and ideal learning strategies) do not translate into better quiz 
and exam performance, then questions about the gcncralizability of 
these earlier lab-based findings would arise. 

In addition, studies such as this one provide important prescriptive 
information about where supplemental instruction programs such as 
PASS can be expected to impact students' performance and which stu¬ 
dents arc likely to attend. Tbat is, the data in the present study suggest 
that PASS, at least as it is implemented at this university, can be expected 
to help students perform better on unit quizzes as well as to retain 
information across the entire semester. Although PASS and non-PASS 
attendees began the semester performing similarly on the first quiz, 
PASS attendees scored higher on each of the remaining quizzes and 
significantly higher on three of the five. For each of these three quizzes, 
the Cohen’s d values were moderate to large (i.c., d > .50), suggesting 
that the impact of PASS was substantial in that PASS attendees scored 
half a standard deviation, or more, higher than the non-PASS attendees. 
TTicsc differences in quiz grades support the idea that PASS attendance 
benefits short-term retention of course information. Even more impres¬ 
sive was the finding that PASS attendees scored significantly higher on 
the cumulative final exam, again with Cohen's d suggesting a moderately 
large eff ect of PASS. Apparently the study skills the students learned in 
PASS allowed them to encode the information more effective^ initialh' 
and to facilitate the long-term retention of course information as reflected 
by their performance on the cumulative final exam. 
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In addition to insight about how PASS might affect retention of course 
material, PASS was found to influence the distribution of final grades 
and attrition rates. Whereas no students in the non-PASS group earned 
an A in the course, 21 % of students who attended PASS did. Only 15% 
of PASS attendees earned a D or F, whereas 40% of non-PASS attendees 
did. PASS attendees not only performed better but also were less likely 
to withdraw from the class, either officially or unofficially. 'Hicse results, 
in keeping with prior research about the benefits of PASS attendance, 
combine with the observed Cohen's d and partial eta-squared values 
to suggest that PASS dircctfy affected students' short- and long-term 
performance in the class. That PASS had such a large impact when so 
many factors combine to influence class grades further supports how 
beneficial and effective the PASS program is. 

Of additional interest were the factors that correlated with PASS atten¬ 
dance. Early in the semester, academic self-efficacy (as assessed with the 
SELF) correlated with PASS attendance, but only when students with low 
and high levels of self-efficacy were examined separately. Later in the 
semester when students had learned more about the course as well as 
about the professor’s teaching and testing style, self-efficacy no longer 
predicted PASS attendance. This result suggests sclf-efficacy seems to 
matter only when students have little knowledge of the course or other 
information upon which to base their decision to attend PASS. Perfor¬ 
mance measures (high school GPA and ACT scores) did not correlate 
with PASS attendance. Unlike the results from prior research conducted 
by Martin and Arendale (1992), we did not find that academically pre¬ 
pared students were more likely to attend PASS. Examination of Tkblc 
1 suggests that there might have been too little variability in these 
measures for the correlations to prove reliable. Because PASS and non- 
PASS students were so similar on both performance measures, it would 
have been difficult to see any relationship between these measures and 
PASS attendance. Nonetheless, the differences between the PASS and 
non-PASS students' quiz, exam, and final grades suggest that students 
of all levels of academic preparation benefitted from PASS attendance. 

Such findings have important prescriptive implications for administra¬ 
tors eager to identify which students arc likely to attend PASS or other 
SI programs voluntarily and who might need additional encouragement. 
Our data suggest that knowing about students' academic self-efficacy 
levels might provide more information about PASS attendance than tra¬ 
ditional measures of ability, but that both academically weak and strong 
students may benefit from PASS. Specifically, our results suggest that 
administrators who arc concerned about students in high-risk courses 
should focus PASS recruitment efforts on those with lower self-efficacy, 
given that these students arc less likefy to participate in SI activities 




22 


Journal of College Reading and Learning. 42(2) Spnng 2012 


such as PASS that could affect their grades in the short-term and their 
academic self-efficacy in the long-term. 

These results arc important both because they support the benefits of 
desirable difficulties (Bjork, 1994) when implemented in supplemental 
instruction programs such as PASS, and because they provide important 
information to university administrators about who is likely to participate 
in academic enrichment programs. Academic institutions concerned about 
attrition and students' preparedness to transition to college must find 
ways to help students under tight budget constraints. Results from studies 
such as this one provide insight about where administrators could allocate 
resources to gain maximum benefit for the largest number of students. 

Of course, while many practical implications stem from studies such 
as this, limitations apply as well. For example, the multiple-choice 
quizzes and the final exam that we used arc common in large sections 
of introductory-level courses, but arc neither complete nor ideal mea¬ 
sures of course knowledge. Nonetheless, the very courses most likely 
to use multiple-choice measures (large introductory-level courses) arc 
also the classes most likely to be classified as high-risk. Multiple-choice 
measures may prove problematic if they provide an inaccurate reflec¬ 
tion of students’ knowledge. Multiple-choice measures may also lead 
students to overestimate their ability’ to do well, which might affect 
their decision to participate in SI programs such as PASS. Although the 
type of test might influence attendance decisions, a second limitation 
in this study was that a variety’ of additional factors could have affected 
students' decisions to attend PASS (c.g., work and class schedules, when 
the PASS sessions were held). Given the large number of variables that 
likely combine to influence students’ decisions to participate in SI pro¬ 
grams, it becomes difficult to identify which variables have the greatest 
influence on PASS effectiveness and attendance. Moreover, we do not 
know whether the factors arc the same for different students. Other 
limitations were our sample size and the fact that we did not include 
or assess alternate treatments (c.g., individual tutoring) that might also 
yield enhanced course performance. 

Future research could examine these issues as well as the long-term 
benefits of PASS. Specifically, it would be helpful to know whether students 
who experience the benefits of PASS in one course arc able to transfer 
those skills to other high-risk courses. Although PASS is currently designed 
to teach course-specific study skills, it would be ideal to evaluate empiri¬ 
cally which courses might be more or less likely to allow transfer of study’ 
skills and which might necessitate their own PASS leaders. Furthermore, 
it would seem worthwhile to determine how long course information 
is retained. Our results provided evidence that PASS benefits long-term 
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retention of course content throughout a semester, but it remains an open 
question as to how long the material is maintained after the semester is 
over. Bahrick's (1984) work suggests that individuals remember more 
information for longer periods of time than they might suspect. Yet it 
remains possible that the forgetting curve is different for PASS versus 
non-PASS attendees. Researchers’ ability to demonstrate that the study 
methods taught and used in PASS alter how much information is forgot¬ 
ten and how quickly could provide justification for initiating SI programs 
even in these austere economic times. Such findings would also provide 
more support for the PASS program’s effectiveness. 
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Footnotes 

1 Although students attend PASS on a voluntary basis, PASS leaders are asked to track 
students' attendance to allow comparison of attendees and nonattendees' performance 
in the c la ss . Participation levels are also monitored by administrators to determine xleal 
tiroes for PASS sessions to be held 


2 


PASS leaders are required to track whether the material discussed in PASS sessx>ns was 
assessed on quixzca/exams as well as how PASS attendees performed, so as to allow 
the leaders to adapt then sessions and strategies taught as needed, lb facilitate this 
reporting process, the quizzes and final exam were provided to the PASS leader the day 
before each quiz/exam. In no case was any PASS session held after the PASS leader 


received the quizzes or final exam to eliminate any concerns of “teaching to the test' 


3 It remains unknown how 
Once students declined to 


out of PASS or their reasons for doing so. 
our study, we no longer kept statistics on them 


4 All reported analyses were run twice - first with PASS treated as a binary vumble (attended 
vs. did not attend) and again with PASS attendance classified in a more fine-tuned man¬ 
ner where participants were only considered attendees for the quizzes for whxh they 
had aauiHy attended PASS—to assess whether this would alter our results In all cases 
the pattern of results was similar. We opted to report the results based on the binary 
classification for PASS under the a&surnpdon that t h is dassificatton scheme should work 
against rather than in our favor Specifically, grouping those who attended PASS once 
with those who attended multiple times would reduce rather than increase the apparent 
benefits of PASS We found this to be the case Specifically, when examining quiz scores 
for those who had actually attended PASS before each quiz versus those who hid not 
attended fee that quiz, we found that the quiz scores were reliably different for all but 
the first quiz-Quiz l.*(65) - .10,p > OS. d - .07, Cfcnx 2. 1(65) - -3.30 ,p< .01, d - 
». Quiz 3; *(65) - .2.55, p < .05, d - 65, Quiz 4 1(65) - <3.17. p < .01, d - 
5 1(65) - M 38, p < .01, d - 1 14. Qjnz6: *(65) - .2.58, p < .05,4 - .63. 


5 Students were asked to self-report their high school grade point average and ACT or 
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SAT scores However wc later rented there scores by examining each student's 
academic record, with students' permi&sxin. and all SAT scores were converted to their 
ACT equivalent to provide a consistent basis for comparison 



